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ABtSTRACT 

The 1972-'73 Michigan Educational Assessment Program 
(HEAP) provided information on 22 measures of students and schools. 
Shile some of the data were gathered in routine Michigan Department 
of Education re ports ^ student perfcyrmance data were gathered using 
the Michigan Assessment of Basic Skills battery, Form VMT during 
January 1973. The battery consisted of four tests: Word 
Relationshipsr Reading^ Mechanics of Written English ^ and 
Mathematics. For each of the four tests at each grade levels the raw 
score distribution was transformed into an equated standard score 
corresponding to 1969-70 assessment tests. While some of the 
reliability estimates of the brief subtests are not high enough for 
the assessment of individual studentSr the estimates for the four 
tests and the composite scores are sufficiently high for that 
purpose. None of the tests was unduly speeded. A majority of the 
fourth grade achievement tests were somewhat difficult for students 
at grade 4 and a majority of the seventh grade tests were of. somewhat 
less than average difficulty for seventh graders. .The tests contain 
items that possess acceptable to excellent ability to discriminate 
between high- and low^scoring students. (Author/DEP) 
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INTRODUCTION 

The Michigan Educational Assessment Program (HEAP) is designed to 
assess educational needs in the state. HEAP provides basic information 
about the educational attainments of fourth and seventh graders and the 
allocation of resources for all Michigan school districts. A complete 
description of the Michigan Educational Assessment Program may be found 
in the publication entitled Objectives and Procedures^ , which was the 
first report of the 1972-73 MEAP. 

The primary function of this report is to provide the technical 
information needed to evaluate the instruments and techniques used in the 
1972-73 educational assessment program. The report is intended primarily 
for people with some expertise in psycbome tries, such as directors of 
research, research consultants, and school counselors. 
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•^ Objectives and Procedures of the Michigan Educational Ass essment 
Program, 1972-73 > 1972-73 Assessment Report No. 1, 1972. Lansing, 
Michigan: Michigan Department of Education. 



THE 1972-73 MICHIGAN EDUCATIONAL ASSESSMENT PROGRAM 



The 1972-73 Michigan Educational Assessment Program provided 
information on twenty-two measures of students and schools, A list of 
these measures is presented in Table 1, They can be classified into 
four major categories: school resources; student background; school and 
student performance; and, school or school district size, A complete 
definition of each measure is given in the Local District and School Report: 
Explanatory Materials ^, The report that follows provides technical information 
about the development and reporting of school and student performance 
measures. Included for the first time this year are correlations computed 
at the district and school levels. 

In January, 1973, all students who ware receiving regular classroom 
instruction in the content areas of reading, English, and mathematics at 
the fourth and seventh grade levels in the public schools of Michigan 
participated in the educational assessment program. Table 2 shows the 
number of districts, schools, and students from or about which information 
was obtained for the 1972-73 assessment program. The information in this 
table represents the maximum number of units from which the data were 
obtained. The numbers reported in Table 2 may vary from the numbers of 
schools and districts reported elsewhere. These differences arise because 
data for some schools and districts were not available for every variable 
and because schools and districts which tested fewer than five students, as 
well as all non K-12 districts, were not included in normative distributions 
nor in the computation of correlations, 

^Local District & School Report: Explanatory Materials , The Third Report 
of the 1972-73 Michigan Education Program , Lansing, Michigan: Michigan 
Department of Education, April, 1973« 
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TABLE 1. 

MEASURES AND SOURCT^S OF BASIC DATA^ 

MEASURES SOURCE 

District School Student 

I. School Resources 

A, Human Resources 

(1) Prof:ssional Instructional Staff 

per 1,000 pupils X 

(2) Teachers per 1,000 pupils X 

(3) Average Years of Teaching Experience X 

(4) Percenc of Teachers with Masters Degree X 

(5) Average Contracted Salary of Teachers^ X 

B. District Financial Resources (1971-72) 

(6) State Equalized Valuation per 

Resident Member X 

(7) Local Revenue per Pupil X 

(8) State School Aid per Pupil X 

(9) K-12 Instructional Expense per 

Pupil X 

(10) Elementary Instructional Expense per 

Pupil X 

(11) Total Current Operating Expense per 

Pupil ^ X 

(12) Total Operating Millage-' X 

II. Student Background 

(13) Percent of Racial-Ethnic Minority X 
III. School/Student Performance 

A. Developed Verbal Ability 

(14) Word Relationships X 

B. Basic Skills Measures 

(15) Reading X 

(16) Mechanics of Written English X 

(17) Mathematics X 

(18) Basic Skills Composite Achievement X 

C. Dropout Rate 

(19) School Dropout Rate (1971-72) X 
IV. School or District Size 

(20) Total Membership^ X 

(21) Grade 4 Membership^ X 

(22) Grade 7 Membership^ ^ X 
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"Hjnless otherwise indicated, data for these measures were collected in 1972-73. 
^Substantially changed since the 1971-72 MEAP program. 
•^New since the 1971-72 MEAP program. 
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TABLE 2. 



NUMBERS OF DISTRICTS, SCHOOLS, AND STUDENTS 
PARTICIPATING IN THE 1971-72 ASSESSMENT PROGRAM 

Grade No> of Districts No, of Schools No, of Students 

4 593 2,462 160,615 

7 570 878 163,925 



TESTS OF BASIC SKILLS 

The 1972-73 tests of basic skills consisted of four tests: Word 
Relationships, and achievement tests in Reading, Mechanics of Written 
English, and Mathematics. Like its predecessors, specifications for the 
battery were developed cooperatively by staff from Educational Testing 
Service, committees of Michigan teachers and other educators > and the 
Michigan Department of Education. 

Test items for the tests were reviewed and final tests constructed 
by six different test committees with the aid of Educational Testing 
Service developmental specialists. The following is a description of tne 
process used to develop the specifications, select the items and construct 
the final tests. 

Development and Review of Items 

In February, 1971, members of the Michigan Department of Education 
began to explore ways of getting Michigan teachers and administrators 
more involved in the test development process of the Michigan Educational 
Assessment Program. They were yarticularly interested in the formation 
of committees which would enable them to bring the ideas, knowledge, and 
experience of Michigan educators to bear on the problem of making the 



Michigan Assessment of Basic Skills a more appropriate test for Michigan 
students* 

In June the Department solicited nominations for committee member- 
ship by contacting appropriate Michigan education associations. From 
the nominees, the Department formed six test committees — one for each 
of three subject matter areas (English, reading, and mathematics) at 
each of two grade levels (fourth and seventh). In general, each committee 
was composed of an administrator, subject matter specialists, and class- 
room teachers with a strong background in the subject matter. 

The committees formed in 1971 continued their work in preparing the 
tests for this 1972-73 administration. They participated in workshops 
that included representatives from the Department and test specialists 
from Educational Testing Service. (Committee members attending the 1972 
meetings are listed in Appendix C.) In the course of the workshops held 
August 28 and 29, 1972, content specifications from previous years were 
reviewed and revised. Equating items were selected from form UMT (admin- 
istered January, 1972) to be used in form VMT (administered January, 1973). 
The number of items in the Word Relationship test for seventh grade was 
reduced from 50 to 38. The sequence of tests was altered so that the 
Reading test would preceed the Word Relationship test for both grade 4 and 
7. The number of items in the Reading test for grade 7 was increased from 
50 to 60 items and a separately timed section containing synonyms was added. 
A separately timed section containing 15 grammar and usage items was added 
to the seventh grade Mechanics of Written English test. To accommodate 
this addition the number of effectiveness of written expression items was 
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reduced from 18 to 15, the number of capitalization and punctuation items 
was reduced from 20 to 14, and the length of the test was allowed to 
increase from 60 to 64 items • 

The test development specialists from Educational Testing Service 
provided information about item statistics and guidance in the techniques 
of reviewing and revising test items. The committee members spent consid- 
erable time reviewing and discussing new materials which had been pretested 
in the 1972 administration and, where appropriate, these were drawn upon 
for the 1972-73 assessment program. 

Description of the Tests of Basic Skills 

The achievement portion of the assessment battery contained individ- 
ually timed tests in Word Relationships, Reading, Mechanics of Written 
English, and Mathematics. Different forms of the tests were administered 
at the two grade levels, but they all consisted of four-option multiple 
choice questions. Table 3 shows the number of items and the time limits 
for each section and sub-section of the tests for each grade level. 
Content specifications and item classifications for each test will be 
found in Appendix B. 

The Word Relationships test was designed to measure the student ^s 
knowledge of the meaning of words and the relationships between words 
and concepts. 

The Reading test assessed paragraph comprehension, ability to 
understand words from the context in which they are encountered, and 
ability to identify the correct synonym for a word. 
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The Mechanics of Written English test consisted of four parts: 
part A, spelling, asked students to identify misspelled words; part Bl. 
effectiveness of written expression, required students to select the best 
way of expressing a thought; part B2. granunar and usage, asked students 
to recognize grammatical errors; and part C, punctuation and capitalization, 
asked students to recognize errors of pinctuation and capitalization. 

The Mathematics test involved mathematical reasoning and problem 
solving. In addition, problems in the seventh grade test involved alge- 
braic and geometric concepts. 
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TABLE 3. 



NUMBERS OF QUESTIONS AND TIME LIMITS FOR EACH SEPARATELY-TIMES 
PART OF THE ASSESSMENT BATTERY (BY GRADE) 



Grade 4 Grade 7 

Questions Time Questions Time 

Word Relationships 45 20 38 15 
Reading 

A. Synonyms 50 35 15 5 

B. Reading Comprehension 45 35 

Mechanics of Written English 

A. Spelling 15 5 20 6 

Bl. Effectiveness of Written 

Expression 14 9 15 9 

C2. Grammar and Usage 14 8 15 8 

CI. Punctuation and 

Capitalization 

(Part C for Grade 7) 12 8 14 7 

(Total Mechanics o. Written 

English) (55) (30) (54) (30) 

Mathematics 40 30 40 30 
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Scale and Reported Score Development 

The raw score on each of the tests of basic skills is the number of 
questions the student answered correctly. For each of the four tests 
at each grade level, the raw score distribution was tra -x ■ into 
standard score distribution equated to corresponding 1969-70 assessment 
tests. 

Equating was performed to associate a single scale with each of the 
four years' test forms. Separate equatings were necessary for each of 
the four tests (Word Relationships, Reading, Mechanics of Written English 
ariJ Mathematics) for each year. First, the January 1970 scores were scaled 
with a meaa of 50 and a standard deviation of 10. Then, the 1971 tests were 
equated to their 1970 counterparts. Next, the 1972 tests were equated through 
the 1971 scores to the 1970 scale. Then, the 1973 tests were equated to 1972 
scores to the 1970 scale. Thus, all four years' test forms have common scales 
for each test — those of the 1970 test form. 

To implement the equating it was necessary to have a minimum of approx- 
imately twenty items per test in common from one year to the next. These 
common items provided "anchor" tests through which the equating was per- 
formed. The Levine"*" method of equating was utilized throughout. 



^Levine. R.S., Equating the Score Scales of Altern ate Forms Administered t_g^ 
Samples of Different Ability . Princeton, N.J.; Educational Testing Service, 
1955. (Research Bulletin 55-23) 
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After these transformations, a Composite Achievement score was 
computed for each student. It consisted of the average of his or her standard 
scores on Reading, Mechanics of Written English, and Mathematics* Appen- 
dix A presents the raw and equated standard score distributions, the con- 
version parameters 5 and the percentile ranks for each test at each grade 
level. It also gives the equated standard score distribution and the per- 
centile ranks for the Composite Achievement scores at each grade level. 

Five equated standard scores were reported for each student tested 
in 1972-73: Word Relationships, Reading, Mechanic. > >f Written English, 
Mathematics, and Composite Achievements 

Psychometric Properties of the Tests of Basic Skills 

At each of the grade levels, 4 and 7, a spaced sample of approxi- 
mately 1,000 answer sheets was drawn from the answer sheets of all the 
students who participated in the program^ These answer sheets provided 
the data for determining the psychometric properties of the four achieve- 
ment tests: Word Relationships, Reading, Mechanics of Written English, 
and Mathematics, and the Composite Achievement score. Table 4 shows 
the summary statistics for these tests for the samples and the total 
groups. Inspection of that table indicates that the fourth grade sample 
is slightly less able than the fourth grade total group, all the sample 
means being a little lower than the total group meai.. . Inasmuch as 
no difference is as large as one raw score point, the standard deviations 
are in close agreement, and there are no statistically significant 
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differences, the differences are judged to be of little practical signifi- 
cance to the analyses. It is assumed, therefore, that the statistics that 
follow which are based on the sample will also describe the total group. 

For the seventh grade the sample is more able and slightly less vari- 
able, on the average, than the total group. The numerical differences be- 
tween the means, however, are small; hence, the sample is considered quite 
satisfactory for analysis purposes. 



TA^LE 4. 

SUMMARY STATISTICS^ ON ACHIEVEMENT TESTS FOR 
SAMPLE AND TOTAL POPULATIONS 





Grade 4 


Grade 7 




Sample 


Total 


Sample 


Total 




Mean 


S.D. 


Mean 


S.D. 


Mean 


S.D. 


Mean 


S.D. 


Word Rfjlationships 


24.91 


9.17 


25.43 


9.25 


22.62 


6.85 


22.01 


6.98 


Read ing 


30.75 


10.44 


31.16 


10.32 


41.26 


11.3.0 


.40.52 


11.62 


Mechanics of 

Written English 


34.03 


10.50 


34.36 


10.61 


43.20 


10.74 


42.45 


10.97 


Mathematics 


24.46 


7,71 


24.76 


7.77 


24.48 


7.82 


24.08 


7.84 



In raw score units 
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The properties of the tests are discussed in the following paragraphs. 
Tables 5 and 6 present the intercorrelations among the tests at gxades 4 
and 7 respectively, and Table 7 presents data on reliability, speededness, 
difficulty, and discrimination. 

Validity : The content validity of the achievement rests, which is 
of utmost importance, can be judged by reviewing the procedures used in 
their development and by inspecting the classification of the test ques- 
tions into content categories. The development of these tests has been 
described in an earlier section of this report, and test specifications 
and classification of test items are presented in APPENDIX B, Examination 
of these sources of information indicates that the tests have high content 
validity. 

The extent to which the tests measure different achievement may be 
judged by the size of the correlation coefficients reported in Tables 5, 
6, and 7, In those tables the intercorrelations among the separately-timed 
tests and the reliabilities of the tests at the fourth grade level and at 
the seventh grade level are shown. The correlations of the scores on the 
separately-timed sections of the Mechanics of Written English test with 
the total Mechanics of Written English score and the Reading subtests 
scores at grade 7 with the total Reading score are not reported since these 
correlations are spuriously high due to the contribution each subtest makes 
to the total score. 

The extent to which each subtest makes a unique contribution to the 
achievements being measured may be judged by considering the differences 
between the correlation of the subtest with other subtests and the relia- 
bility of both subtests. If the correlation is lower than either reliability 

-12^ 
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TABLE 5. 



INTERCORRELATIONS AMONG ACHIEVEMENT TESTS - GRADE 4 





READ- 
ING 


MECHANICS OF WRITTEN ENGLISH 


MATH 


TOTAL 


A 


Bl 


B2 


C 


Word Relationships 


.80 


.78 


.66 


.68 


.69 


.63 


.75 


Reading 




.82 


.68 


.73 


.72 


.61 


.75 


English: Total 














.78 


Section A: Spelling 








.60 


.60 


.55 


.62 


Section Bl: Effective 
Expression 










.69 


.57 


.65 


Section B2: Usage 












o60 


.70 


Section C: Punctuation, 

Capitalization 














.66 
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TABLE 6. 



INTERCORRELATIONS AMONG ACHIEVEMENT TESTS - GRADE 7 





READING 


MECHANICS OF WRITTEN ENGLISH 


MATH 


TOTAL 


A 


B 


TOTAL. 


A 


T» 1 

Bl 


B2 


C 


Word Relationships 


.81 


.71 


.79 


.74 


.60 


.62 


.64 


.60 


.11 


Reading: Total 
A 
o 






.73 


OA 

.oO 
.68 
.79 


.55 
.58 
.63 


.70 
.57 
.70 


. /o 

.56 
.69 


c o 
.0 J 

.53 
.62 


.78 
.65 

11 


English: Total 


















-.73 


Section A: Spelling 












.61 


.55 


.57 


.56 


Section Bl: Effective 
Expression 

B2 Usage 














.67 


.58 
.57 


.64 
.62 


Section C: Punctuation, 
Capitaliza- 
tion 


















.64 
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then each subtest is contributing independently to the measurement. If 
the correlation is equal to or greater than either rel/.ability, then little 
or no unique measurement is being contributed by using both measures. For 
example. Table 5 shows the correlation between part A and part Bl of the 4th 
grade M^schanics of Written English test to be .60. The reliabilities of 
these two parts are .74 and .79 respectively. Since the correlation of .60 
is considerably below either reliability, .74 and .79, it is clear that each 
subtest is making a unique contribution to the total score. 

Reliability ; The reliability estimates reported in Table 7 are measures 
of internal consistency based on a single administration. As such, they 
indicate the extent co which the items that make up the test measure the 
same thing. 

The reliability estimates for the separately-timed parts were computed 
using the Kuder Richardson formula 20; those for the Mechanics of Written 
English total score and for the Composite Achievement score in both batteries 
as well as the Reading total score in grade 7 were computed using this 
formula: 

2w2 SE 2 

Reliability = 1 ^ ^^^^ 

at 

For the Mechanics of Written English and Reading total scores, the 
weights, w were each unity; the standard errors of measurement were those 
of the subsections; and at^ was the variance of the total score. For the 
Composite Achievement score, the weights were the appropriate A values in 
the conversion equations (see Conversion Data , APPENDIX A), the standard 
errors of measurement were those for the three tests (Reading, Mechanics of 
Written English, and Mathematics), and at^ was the composite score variance. 
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As can be seen from Table 7, the reliability estimates reported for the 
subtests of the Mechanics of Written English Test range from ,67 to ,82 indi- 
cating that these brief subtests are not reliable enough ,for the assessment of 
individual students. The estimates reported for the four achievement tests 
and the composite score, however, range from ,86 and ,97 indicating that 
these tests and the composite score are sufficiently reliable^ for that 
purpose. 

The standard errors of measurement, which are indices of the reliability 
of individual test scores, reported in Table 7, are sufficiently low to 
justify the use of these four tests and of the Composite Achievement score 
in the assessment of individual students. 

Speededness : A test is usually judged to be unspeeded if virtually all 
of the students reach a point three quarters of the way through the test and 
eighty percent of the students reach the last question. Inspection of the 
speededness data in Table 7 indicates that the tests at both grade levels 
were not unduly speeded. While not everyone reached the three quarter point 
in any test, in each instance more than eighty percent reached the last 
question. 

Difficulty : The data reported for this property of the tests is the 
avere number of items answered correctly by tha sample, expressed as a 
percentage of the number of items in the test, A test of middle average 
difficulty is preferable for maximum reliability. In a test consisting of 
questions with four alternative answers, middle or average difficulty would 



^Remmers, H. H. and Gage, N. L. E ducational M easurement and Evaluation, 
Revised Edition 1955, Harper and Brothers , New York, pp. 140-141. 
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be represented by 62,5%. This figure is based on the assumption that "average" 
students would know the answers to half of the questions and get a quarter of 
the remaining questions right by guessing. 

Inspection of the percentage indicators of difficulty in Table 7 reveals 
that the majority of the achievement tests including the subtests of Mechanics 
of Written English, were somewhat difficult for the students at grade 4, Only 
the English Usage subtest could be judged as being easier than middle diffi- 
culty. The grade 7 data show that a majority of the tests including subtests 
in Reading and Mechanics of Written English were easier than middle diffi- 
culty. Only the Mathematics and Word Relationships tests and the capitali- 
zation-punctuation subtests could be judged as being rather difficult. 

Additional information about the difficulty of the fourth grade tests 
is summarized on page A-11 in APPENDIX A, At the top of this page are 
frequency distributions of the difficulty index, delta, A four-choice item 
that is known by one-half of the group and answered at random by the re- 
mainder would be expected to yield a delta of about 11,7^, For example, 
the observed mean for Word Relationships exceeds this middle-difficulty 
reference value by more than one half a delta point. 

More important, perhaps, than the average difficulty is the spread of 
difficulty among the items. When the group to be tested represents a broad 
range of ability and when discrimination at both extremes of the ability 
range is required, then it is necessary that the items cover a very wide 
difficulty range. Under those circumstances items of middle difficulty for 
the group as a whole may be altogether too easy for one extreme group and 



A fuller description of the difficulty index, delta, may be found on page 140 
of Thorndike, Robert L, (ed,). Educational Measurement Second Edition: 
Washington: American Council on Education, 1971, 
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too hard for the other. Here, the upper portion of the item difficulty range 
appears to be well represented, but there are few items with deltas in the 
range of 6.0 to 9.0 in most of the tests. The inclusion of even a few items 
within this range in each test would materially reduce the proportions of 
scores that fall in the chance area. It should perhaps be noted here that, 
since the sample is a little less able than the total group, the deltas are 
slight overestimates, but no mean discrepancy is likely to exceed 0.2 delta 
poi it. 

Item statistics for the seventh grade tests are summarized on page A-12 
of APPENDIX A. At the top of the page are frequency distributions of the 
difficulty index, delta. The observed means for the four seventh grade tests 
lie within 10.7 and 11.9, and three of the four are somewhat higher than the 
middle-difficulty reference value. Here, the upper portion of the item 
difficulty range appears to be fairly represented, but a few additional 
items with deltas in the range of 6.0 to 9.0 in those parts with high pro- 
portions of scores in the chance area would result in fewer such scores. 

Discrimination ; An indication of the extent to which each test or 
subtest is internally consistent, i.e., consists of items that discriminate 
between high- and low-scoring students, can be found in the last two columns 
of Table 7. In each instance the index of discrimination reported there is 
the mean biserial correlation between scores on the entire test and 
dichotomized (right vs. wrong) item responses. The mean correlation range, 
which extends from .43 for the punctuation and capitalization subtest at the 
seventh grade to .60 for the grammar and usage subtest at grade four, indi- 
cates that the tests and subtests are composed of items that possess accept- 
able to excellent ability to discriminate between high- and low-scoring 
students. 
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At Che bottom of page A-11 are distributions of the biserial correlations 
between item scores and criterion scores for the fourth grade tests. The 
criterion for the items in the Mechanics of Written English part scores is 
the 55 item total score. Otherwise, the criterion for each set is the score 
on the test noted at the top of the same column. Mean values of ^j^^g range 

from ,48 for the Mechanics of Written English punctuation and capitalization 
subtest to ,60 for the Mechanics of Written English grammar and usage subtest. 

At the bottom of page A-12 are distributions of the biserial correlations 
between item scores and criterion scores for the seventh grade tests. The 
criterion score for the items in the subtests of the Mechanics of Written 
English test is the 64-item total score; similarly, the total score on the 
Reading test is the criterion score for the items that comprise the Reading 
subtests. Otherwise, the criterion for each set is the score on the test 
noted at the top of the same column. Mean values range from .43 for the 
punctuation and capitalization subtest to ,59 for the effectiveness of 
written expression subtest, 

CORRELATIONS 

Product moment correlation coefficients were computed to investigate 
the relationships between pairs of means of student and school measures at 
the district level and at the school level. These correlation coefficients 
were computed using: 

Naxay 

where x is the deviation of each mean, X, from the average of the means, Mx; 
y is the deviation of each mean, Y, from the average of the means. My; N is 
the number of units (districts or schools) involved in the calculations; and 
the two sigmas, ax and ay are the standard deviations of their respective 
distributions. 
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The six intercorrelacion natrices chat resulted from the application of 
this formula to various sets of data from the 1972-73 Assessment Program will 
be found in APPENDIX D. The coefficients presented in these matrices are an 
estimate of the relationships between pairs of: district means (27 measures), 
weighted district means (24 measures), school means at Grade 4 (13 measures), 
weighted school means at Grade 4 (11 measures), school means at Grade 7 
(13 measures), and weighted school means at Grade 7 (11 measures). District 
mean and school mean correlation coefficients are an estimate of the relation- 
ship between two measures when each district or school, regardless of size, is 
given a unit weight in the computations. In these computations, the per pupil 
contribution to each relationship varies inversely with the size of the 
district or school membership. The weighted district mean and school mean 
correlation coefficients are an estimate of the relationship between two 
• measures when each student is given equal weight in the computations regard- 
less of the size of the district or school in which he is enrolled. District 
means were weighted by multiplying the mean of each district by the total 
membership of that district; school means for grade 4 and grade 7 were 
weighted by multiplying each school mean by the appropriate school member- 
ship. 

Many of the correlation coefficients reported in APPENDIX D are spuri- 
ously high because one measure is an integral part of another. For example. 
Professional Instruction Staff per 1,000 pupils, the first measure, includes 
Teachers per 1,000 pupils, the second measure. Similarly, the Composite 
Achievement Scores at both grades are an average of the scores obtained in 
each of the basic skill areas. The interpretation of the coefficients pur- 
porting to estimate the relationship between such measures should be under- 
taken with caution. 
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At the district level, the correlation coefficients between pairs of 
means range from ,0009 for the relationship between K-12 Instructional 
Expense per Pupil and seventh grade Reading scores to ,9654 for the relation- 
ship between seventh grade Reading scores and seventh grade Composite Achieve- 
ment scores. The latter coefficient is spuriously high, however. Correlation 
coefficients for weighted district means range for ,0010 for the relationship 
between the Percent of Teachers with Master's Degrees and fourth grade English 
scores to ,9909 for the relationship between seventh grade Composite Achieve- 
ment scores and seventh grade Reading scores. Again, the latter coefficient 
is spuriously high. 

At the fourth grade level, the correlation coefficients between school 
means range from ,0042 for the relationship between Professional Instruction 
Staff per 1,000 Pupils and Average Contracted Salary of Teachers to ,9799 for 
the relationship between Composite Achievement scores and English scores. 
The coefficients for the weighted school means range from ,0017 for th*e 
relationship between Percent of Rac5.al-ethnic Minority Students and Average 
Years Teaching Experience to ,9847 for the relationship between Composite 
Achievement scores and English scores. In these instances, also, the rela- 
tionship between Composite Achievement scores and English scores is spuriously 
high. 

At the seventh grade level, the lowest correlations for school means are 
,0032 for the relationship between Total Membership and Average Teacher 
Experience and ,0033 for the relationship between Word Relationships and 
Average Contracted Salary of Teachers, The highest coefficient, again a 
spurious one, is ,9831 for the relationship between Composite Achievement 
scores and Reading scores, 
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S UMMARY 

The 1972-73 Michigan Educational . Assessment Program (MEAP) provided 
information on twenty-two measures of students and schools. While some of 
the data were gathered in routine Michigan Department of Education reports, 
student performance data were gathered using the Michigan Assessment of 
Basic Skills battery. Form VMT during January 1973. 

The battery consisted of four tests: Word Relationships, Reading, 
Mechanics of Written English, and Mathematics. For each of the four tests 
at each grade level, the raw score distribution was transformed into an 
equated standard score corresponding to 1969-70 assessment tests. 

Committees of Michigan educators assisted in the development and 
review of the items. In so doing and because of the representativeness 
of the content domain, the tests can be judged as having high content 
valiuity. By comparing correlations among the separately-timed tests and 
the test reliabilities it can be determined that the tests measure different 
achievement areas. 

While some of the reliability estimates of the brief subtests are not 
high enough for the assessment of individual students, the estimates for 
the four tests and the composite scores are sufficiently high for that 
purpose. None of the tests was unduly speeded. 

A majority of the fourth grade achievement tests were somewhat diffi- 
cult for students at grade 4 and a majority of the seventh grade tests were 
of somewhat lass than average difficulty for seventh graders. The tests 
contain items that possess acceptable to e:?cellent ability to discriminate 
between high- and low-scoring students. 
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APPENDIX A 



Tests of Basic Skills 
Raw and Standard Score Distributions, 
Conversion Parameters, and Percentile Ranks 



Z8 



Test Analysis of Form VMT 
Grade 4 
Word Relationships 



Raw 
Score 

V 
A 


Standard 
Score 

V 

I 


f 


Rank of 
Lower Limit 


45 


72 


254 


99.8 


42-44 


69-71 


4412 


97.1 


39-41 


65-67 


9943 


90.8 


36-38 


61-64 


12846 


82.7 


33-35 


58-60 


13853 


73.9 


30-32 


54-57 


14763 


64.6 


27-29 


51-53 


15886 


54.6 


24-26 


47-49 


17213 


43.7 


21-23 


43-46 


17154 


32.9 


18-20 


40-42 


16118 


22.7 


15-17 


36-38 


14108 


13.8 


12-14 


32-35 


11521 


6.6 ' 


9-11 


29-31 


7212 


2.0 


6-8 


25-28 


2575 


0.4 


3-5 


22-24 


533 


0.1 


0-2 


18-20 


86 


0.0 






158477 





raw score mean M^^ = 25 »43 

standard raw score = 9»25 

standard score mean My = 48,6 

standard deviation of Oy = 11*1 
standard scores 

median of raw scores , Md^ = 25 ,21 

(45 items) 

Conversion Data 

Reprint of Form UMT. Scale established for 
Form SMT with mean of 50 and standard deviation of 10. 

A B 
Y = 1.2025 X + 18.0572 



Mx = 




Mdx = 



Test Analysis of Form VMT 
Grade 4 
Reading 



Raw 
Score 

V 

A. 


Standard 
Score 

V 
X 


f 


Percentile 

Rank of 
Lower Limit 
of Interval 


48-50 


66-68 


3210 


98.0 


45-47 


63-65 


9977 


91.7 


42-44 


60-62 


15411 


82.0 


39-41 


57-59 


17418 


71.0 


36-38 


55-56 


17447 


60.0 


33-35 


52-54 


16U2 


49.8 


30-32 


49-51 


14423 


40.7 


27-29 


46-48 


3 2651 


32.7 


24-26 


43-45 


11425 


25.5 


21-23 


40-42 


10435 


18.9 


18-20 


37-39 


9595 


12.9 


15-17 


34-36 


8787 


7.3 


12-14 


31-33 


6769 


3.1 


9-11 


28-30 


3484 


0.9 


6-8 


25-27 


1088 


0.2 


3-5 


23-24" 


260 


0.02 


0-2 


20-22 


37 


0.00 






158559 





Mx = 3 1,16 Conversion Data 

" 10>32 Converted to Michigan 

_. g scale through scores on 45 

y — 2 — ^ord relationships items. 

ay = 9.6 



^ — - — Y = 0.9708 X + 19.5878 

(50 items) 
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Test Analysis of Form VMT 
Grade 4 

Mechanics of Written English 



Raw 
Score 
X 


Standard 
Score 
Y 


L 


Percentile 

Rank of 
Lower Limit 
of Interval 


54-55 


00-69 


7/i1 
/ Hi 


QQ ^ 


51-53 


OD-D / 




yo • J 


AO 


OZ— OH 
t 




oy • / 


AC / "7 

45-47 


oU-ol 


T A A C Q 


oU • D 


AO / / 

42-44 


C "7 CO 

57-59 


loZlZ 


/U.J 


39-41 


C A 


io JOi 




O o o 

36-38 


C T CO 

51-53 


T C Q CT 

15o51 


DU • u 


o o o c 

33-35 


/ o cr* 

4o-50 


1 A A 0 1 




o /^ o o 

30-32 


Ac A "7 


1 J5Uo 




27-29 


/ o / / 

43-44 


1 O A O "7 

12027 


OA 7 


24-26 


40-42 


10489 


18.1 


21-23 


37-39 


8996 


12.4 


18-20 


34-36 


7586 


7.6 


15-17 


31-33 


5951 


3.9 


12-14 


28-30 


3828 


1.5 


9-11 


26-27 


1750 


0.4 


6-8 


22-24 


444 


0.1 


3-5 


19-21 


105 


0.01 


0-2 


17-18 


21 


0.00 






158403 





Mx = 34.36 Conversion Data 

~ 10.61 Converted to Michigan 

_ AQ c scale through scores on 25 

y ~ — ^-i — items in common with Fonn 

Oy = 10.0 UMT. 



(55 items) Y = 0.9436 X + 17.0786 

A-3 
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Test Analysis Form VMT 
Grade 4 
Mathematics 



Raw 
Score 

y 

A 


Standard 
Score 

Y 
1 


f 


rercenu e 

Rank of 
Lower Limit 
or inuezvax 


40 


70 


514 


99.7 


38-39 


67-68 


4069 


97.1 


36-37 


65-66 


7697 


92.2 


34-35 


62-64 


10661 


85.5 


32-33 


60-61 


12766 


77.4 


30-31 


57-59 


13738 


68.8 


28-29 


55-56 


14132 


59.8 


26-27 


52-54 


14095 


50.9 


24-25 


50-51 


13684 


42.3 


22-23 


47-49 


12898 


34.1 


20-21 


45-46 


11756 


26.7 


18-19 


43-44 


10393 


20.1 


16-17 


40-41 


9110 


14.4 


14-15 


o o on 

38-39 


7918 


9 .4 


12-13 


35-36 


6502 


5.3 


10-11 


33-34 


4508 


2.4 


8-9 


30-31 


2462 


0.9 


6-7 


28-29 


980 


0.2 


4-5 


25-27 


293 


0.1 


2-3 


23-24 


68 


0.01 


0-1 


20-22 


14 

158258 


0.00 
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Mx = 24.76 
ax = 7.77 
My = 50.9 



= 9.6 



ay 

Mdx = 25.29 
(40 items) 



Conversion Data 

Converted to Michigan 
scale through scores on 21 
items in common with Form 
UMT. 

A B 
Y = 1.2330 X + 20.3475 



32 



Test Analysis of Form VMT 
Grade 4 
Composite Achiever^ent 



otanaard 
Score 
Y 


f 


Percentile 

Lower Limit 
of Interval 


69 


14 


99.99 


66-68 


1929 


98.8 


63-65 


8970 


93.1 i 


60-62 


15819 


83.1 1 


57-59 


19219 


70.9 


54-56 


19047 


58.9 


51-53 


17775 


47.7 


48-50 


15864 


37.6 


45-47 


14404 


28.5 






20.4 


39-41 


10789 


13.6 


36-38 


9284 


7.7 


33-35 


7386 


3.0 


30-32 


3962 


0.5 


27-29 


744 


0.1 


24-26 


97 




21-23 


19 

158136 





Conversion Data 

Average of Reading, 
Mechanics of Written ♦ 
English, and Mathematics 
scaLad scores. 

Possible score: 19--69, 



A-5 



33 



Mdx = 51.1 



Test Analysis of Form VMT 
Grade 7 
Word Relationships 



s 

Raw 
Score 

Y 
A 


Standard 
Score 

V 

I 


f 


r ce 

Rank of 
Lower Limit 


38 


72 


86 


99.9 


36-37 


69-71 


1223 


99.2 


34-35 


66-68 


4522 


96.4 


32-33 


64-65 


8505 


91.1 


30-31 


61-62 


12143 


83.6 


28-29 


58-59 


14174 


74.8 


26-27 


55-56 


15241 


65.4 


2A-25 


52-53 


15600 


55.7 


22-23 


49-50 


15267 


46.2 


20-21 


46-47 


14567 


37.2 


18-19 


43-44 


13550 


28.8 


16-17 


40-41 


13048 


20.7 


14-15 


37-38 


12165 




12-13 


34-36 


9761 


7.2 


10-11 


31-33 


6335 


3.2 


8-9 


28-30 


3327 


1.2 


6-7 


25-27 


1359 


0.3 


4-5 


22-24 


420 


0.1 


2-3 


19-21 


102 


0.01 


0-1 


16-18 


14 

161409 


0.00 



Conversion Data 

Converted to Michigan scale 
through scores on 38 items 
in common with Form UMT* 



A B 
Y = i*4732 X + 16.3636 





22.01 


Ox = 


6.98 


My = 


48.8 


ay = 


10.3 


Mdx = 


22.32 


(38 


items) 
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Test Analysis of Form VMT 
Grade 7 
Reading 



Raw 
Score 
X 


Standard 
Score 
Y 


f 


Percentile 

Rank of 
Lower Limit 
of Interval 


60 


65 


807 


99.5 


57-59 


63-64 


8248 


94.4 


54-56 


60-62 


13635 


86.0 


51-53 


58-60 


15154 


76.6 


48-50 


56-57 


15597 


66.9 


45-47 


53-55 


15118 


57.6 


42-44 


51-52 


14610 


^8.5 


39-41 


48-50 


13399 


40.3 


36-38 


46-48 


12476 


32.5 


33-35 


43-45 


11300 


25.5 


30-32 


41-43 


10114 


19.3 


27-29 


39-40 


8545 


14.0 


24-26 


36-38 


7058 


9.6 




34-35 


5655 


6.1 


18-20 


31-33 


4276 


3.5 


15-17 


29-31 


2984 


1.6 


12-14 


26-28 


1708 


0.6 


9-11 


24-25 


684 


0.2 


6-8 


21-23 


197 


0.04 


3-5 


19-20 


49 


0.01 


0-2 


16-18 


15 

161629 


0.00 



t Mx = 40.52 

Ox = 11.62 
My = 49.6 
a = 9.4 

y 

Mdx = 41.99 

(60 items) 

ERIC 



Conversion Data 

Converted to Michigan scale 
through scores on 38 word 
relationships items. 

A B 
Y = 0.8069 X + 16.8707 

A-7 

35 



Test Analysis of Form VMT 
Grade 7 

Mechanics of Written English 



Raw 
Score 
X 


Standard 
Score 
Y 


f 


Percentile 

Re ik of 
Lowt c Limit 
of Inverval 


63-64 


68-69 


469 


99.7 


60-62 


65-67 


3630 


97.5 


57-59 


62-64 


8420 


92.2 


54-56 


60-61 


13128 


84.1 


51-53 


57-59 


16602 


73.8 


48-50 


54-56 


17764 


62.8 


45-47 


51-53 


17731 


51.8 


42-44 


49-51 


16508 


41.6 


39-41 


46-48 


14493 


32.6 


36-38 


43-45 


12139 


25.1 


33-35 


41-42 


9930 


19.0 


30-32 


38-40 


8133 


13.9 


27-29 


35-37 


6562 


9.9 


24-26 


33-34 


5240 


6.6 


21-23 


30-32 


4240 


4.0 


18-20 


27-29 


2989 


2.1 


15-17 


24-26 


1955 


0.9 


12-14 


22-24 


949 


0.3 


9-11 


20-21 


343 


-0.1 


6-8 


17-19 


127 


0.1 


3-5 


14-16 


68 


0.01 


0-2 


11-13 


24 


0.00 






161444 
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= 42.45 


Ox 


= 10.97 


My 


= 49.2 


ay 


= 9.9 


Mdx 


= 43.98 



(64 items) 



Conversion Data 

Converted to Michigan scale 
through scores on 35 items 
in common with Form UMT, 

A B 
Y « 0.8992 X + 11.0004 



A-8 



S6 



Test Analysis of Form VMT 
Grade 7 
Mathematics 



Raw 
Score 
X 


Standard 
Score 
Y 


f 


Percentile 

Rank of 
Lower Limit 
of Interval 


40 


69 


843 


99o5 


38-39 


67-68 


4413 


96.7 


36-37 


65-66 


7357 


92.2 


34-35 


62-63 


9534 


86.3 


32-33 


60-61 


11003 


79.4 


30-31 


57-59 


12049 


72.0 


28-29 


55-56 


12751 


64.0 


26-27 


53-54 


13174 


55.9 


24-25 


50-51 


13378 


47.6 


22-23 


48-49 


13447 


39.2 


20-21 


45-4; 


13240 


31.0 


18-19 


43-44 


12540 


23.2 


16-17 


41-42 


11605 


16.0 


14-15 


38-39 


9839 


y.y 


12-13 


36-37 


7642 


5.2 


10-11 


33-35 


4812 


2.2 


8-9 


31-32 


2417 


0.7 


6-7 


29-30 


848 


0.2 


4-5 


26-27 


205 


0.03 


2-3 


23-25 


47 


0.003 


0-1 


21-22 


5 

161149 


0.000 





24.08 


Conversion Data 




7.84 


Converted to Michigan scale 


My = 


50.3 


through scores on 22 items 


ay = 


9.4 


in common with Form UMT. 


Md^ = 


24.09 


A B 


(40 


items) 


Y = 1.1964 X + 21.4910 
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Test Analysis of Form VMT 
Grade 7 
Composite Achievement 



Standard 
Score . 
Y 


f 


Percentile 

Rank of 
Lower Limit 
of Interval 


66-68 


1029 


99.4 


63-65 


7319 


94.8 


60-62 


14393 


85.8 


57-59 


18007 


74.6 


54-56 


19729 


62.3 


51-53 


19952 


49.9 


48-50 


18604 


38.3 


45-47 


16332 


28.1 


42-44 


13867 


19.4 


39-41 


11390 


12.3 


36-38 


8428 


7.1 


33-35 


6178 


3.2 


30-32 


3688 


0.9 


27-29 


1304 


0.1 


24-26 


173 


0.01 


21-23 


15 


0.001 


18-20 


1 

160409 


0.000 



Conversion Data 

Average of Reading, 
Mechanics of Written English 
and Mathematics scaled scores. 

Possible Range: 16-68 



My = 49.7 

Oy = 8.7 
Mdy = 50.5 
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Form VMT Grade 4 



Frequency Distributions, by Sections 
of Original Deltas and Biserial Correlations 





Word 
Relationships 




Mechanics of Written English 




Delta 


Reading 


A 


Bl 


B2 


C 


Total 


Math 


16.0-16.9 


1 














1 


15.0-15.9 




1 








1 


1 


3 


14.0-14.9 


7 


6 


3 








3 


3 


13.0-13.9 


11 


9 


2 


2 


2 


4 


10 


5 


12.0-12.9 


8 


5 


2 


6 


4 


2 


14 


8 


11.0-11.9 


10 


12 


3 


3 




2 


8 


3 


10.0-10.9 


2 


7 


2 


1 


2 


3 


8 


7 


9.0-9.9 


2 


5 


1 


2 


3 




6 


6 


8.0-8.9 


3 


3 


2 




3 




5 


2 


7 O 7 Q 


1 
J. 


1 
J. 












1 


C Ck C Q 




1 
J. 












1 


iotai Items 






15 


14 


14 


12 


55 


40 


Mean delta 




J. JL • \J 


11.8 


11.7 


10. *8 


12.3 


11.6 


11.7 


a 


1 Q 

1 .y 




1.9 


1.2 


1.8 


1.5- 


1.7 


2.3 






































.70-. 79 


1 


8 






4 




4 


4 


.60-. 69 


14 


17 


2 


4 


3 


1 


10 


14 


.50-. 59 


18 


11 


6 


7 


3 


4 


20 


10 


.40-. 49 


9 


8 


6 


2 


4 


5 


17 


9 


.30-. 39 


3 


5 




1 




2 


3 


0 


.20-. 29 




1 


1 








1 




Total items 


45 


50 


15 


14 


14 


12 


55 


39 


Not complete 
















1 


Mean delta 


.55 


.57 


.50 


.55 


.60 


.48 


.53 


.56 


0 


.10 


.12 


.10 


.08 


.11 


.08 


.11 


.10 
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Form VMT Grade 7 

Frequency Distributions, by Sections 
of Original Deltas and Biserial Correlations 



Delta 


Word 


Reading 


Mechanics of Written English 


Math 




■R 
JJ 


1 U LdX 


A 


dJL 




C 


Total 


16.0-16.9 


1 


















1 

X 


15.0-15.9 


3 




1 


1 








1 


1 


1 
X 


14.0-14.9 


4 


1 


— 


1 


3 




1 


2 


6 


■J 


13.0-13.9 


5 


4 


3 


7 


2 


1 


- 


- 


3 


Q 
o 


12.0-12.9 


6 


3 


7 


10 


3 


1 


3 


5 


12 


A 
*+ 


11.0-11.9 


5 


2 


9 


11 


4 


1 


1 


5 


11 


Q 


10.0-10.9 


5 




8 


8 


3 


4 


2 




9 


f. 
»y 


9.0-9.9 


3 


1 


9 


10 


2 


5 


2 


1 


10 


■J 


8.0-8.9 


4 


2 


3 


5 


2 


1 


3 




6 




7.0-7.9 


1 


1 


2 


3 


1 


2 


1 




4 


5 


6.0-6.9 


1 


1 


3 


4 






2 




2 




Total items 


38 


15 


45 


60 


20 


15 


15 


14 


64 


40 


Mean delta 


11.9 


11.3 


10.6 


10.7 


11.3 


9.9 


10.0 


12.5 


10.9 


11.6 


a 


2.4 


2.5 


1.9 


2.1 


2.0 


1.7 


2.2 


1.6 


2.1 


2.2 


* 


rbis 






















.70-.79 


2 


1 


7 


8 




2 






2 




.60-. 69 


9 


2 


12 


14 


7 


5 






12 


17 


.50-. 59 


14 


7 


17 


24 


7 


7 


7 


4 


25 


14 


.40-. 49 


7 


3 


8 


11 


4 




3 


7 


14 


7 


.30-. 39 


6 


1 


1 


2 


2 


1 


4 


2 


9 


2 


.20-. 29 














1 




1 




.10-. 19 
















1 


1 




Total items 


38 


14 


45 


59 


20 


15 


15 


14 


64 


40 


Not complete 




1 




1 














Mean -lelta 


.52 


.55 


.58 


.57 


.54 


.59 


.45 


.43 


.51 


.57 


0 


.11 


c09 


.10 


.09 


.09 


.09 


.10 


.10 


.11 


.09 
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APPENDIX 3 

Basic Skills Test Question Classifications 
and Content Specifications 
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Word Relationships - Form VMT 
Grade 4 



Subject Relationship 



1. 






2. 






3. 






4. 






5. 






6. 






^1 


-Geography , — .-. 


. . -i ~ Associated- with- 


8. 






9. 






10. 






11. 






12. 






13, 






14. 






15. 






16. 


Human Relationships . 




17. 






18. 






19. 






20. 






21. 






22. 






23. 


Human Relationships . 




24. 


Human Relationships . 




25. 






26. 






27. 






28. 


Human Relationships . 




29. 






30. 






31. 






32. 






33. 


rium'^n Relationships . 




34. 






35. 






36. 






37. 






38. 






39. 






40. 






41. 






42. 






43. 






44. 


Human Relationships . 




45. 
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Word Relationships - Form VMT 
Grade 7 



Subject Relationship 



!• 






9 












A 




^ ^ 1 ^ ^ ^ ^ 


C 

3 • 






o. 






7 






Q 






9. 






10# 






11 • 






12. 






IJ* 






14, 






15. 






16. 






1 7 
J / • 






18. 




M ^ M A« M ^ A« ,M 


19. 




/^t^ _ _^ A- ^ — ^ ^ — . 4« ^ ^ >^ ^ 


20. 






21. 






22* 




■ ^ V« ^ ^* ^ ^ 4« ^ ^* ^ 4« ^ ^ ^ ^ 


23. 






24. 






25. 






26. 






27. 






28. 






29. 






30. 






31. 






32. 






33. 






34. 






35. 






36. 






37. 






38. 







B-2 
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Reading - Form VMT 
Grade 4 



1 


nULCiS oyilUIljrlU 




2. 


Wn T<1 vn nn vm 




• 


nO L Uo J. JL JLlio I. L a L J. Vc 




4. 


Wnf <1 ana 1 V Q is 




Q 

J • 


woLusiJLJLUoi.Lai.ive 




A 
u • 


Urt /I e e xrn Ti vm 
tVUlUo &>yilUl£jrlU 




7 
/ • 


w 0 L Q 0 *~ iJL JL u s L L a w 1 V e 




Q 
o • 


IJn i1 Q Q n n vm 
wu L uo 0 y iiULijr lu 




Q 

y • 


WOl Uo J. JLJLuol. Lai. J. Vc 




JLU • 


wol Uo oynonyin 




1 1 


wolus anajLy SIS 




1 O 


Words-synonym 






wolus 'synonyiu 




1 /• 


Words— synonym 




1 ^ 
Xj * 


wolus— syuonyui 




1 A 
JLO • 


oencences xnierence 




1 7 


oencences— scl aigncrorwara 


comprenens ion 


JLO • 


OcIlLcIiCco j.Iii.cL cIlCc 




1 Q 
Xy • 


Dsnuences— 0 LLaignurorwara 


T\ "V* ^ V\ ^ 0 A f>Yy 

comp L ciicno j.on 




Sentences—inference 




91 


Dcnuoncco j.ni.cL cncc 




22. 


Sentences-Straightforward 


comprehension 


23. 


Sentences-straightforward 


comprehension 


24. 


Sentences-inference 




25. 


Sentences-straightforward 


comprehension 


26. 


Sentences-inference 








3 
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27. Sentences-straightforward comprehension 

28 • Sentences-inference 

29 • Sentences-straightforward comprehension 

30 • Sentences-inference 

31 . Passage-narrative 

Item classification-fact 

32, Passage-narrative 

Item classification-fact 

33 • Passage-narrative 

Item classification-inference 

34 • Passage-narrative 

Item classification-application of ideas 

35 . Passage-narrative 

Item classification-main idea 

36 . Passage-narrative 

Item classification-inference 

37 . Passage-science 

Item classification-fact 

38 . Passc^ge-science 

Item classification-fact 

39. Passage-science 

Item classification-application of ideas 

40 . Passage-narrative 

Item classification-main idea 

41 . Passage-narrative 

Item classification-inference 

42 • Passage-narrative 

Item classification-inference 

43. Passage-narrative 

Item classification-inference 

44 . Passage-narrative 

Item cldssif ication-main idea 

45 • Passage-narrative 

Item classification-inference 

B-4 
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46 • Passage-narrative 

Item classification-inference 

47, Passage-social studies 

Item classif ication-Tnain idea 

48. Passage-social studies 

Item classification-inference 

49. Passage-social studies 

Item classification-inference 

50, - Pa-asage-soc-icil '3r-tudie3 - 

Item classification-inference 



B-5 
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Reading - Form VMT 
Grade 7 

Synonyms 



Sentences-words in context 



Reading Comprehension-fact /opinion 

Reading Comprehension-inference 

Reading Comprehension-sequence of events 

Reading Comprehension-fact /opinion 

Reading Comprehension-inference 

Reading Comprehension-fact/opinion 

Reading Comprehension-sequence of events 

Passage-science 

Item classification-fact 

Passage-science 

Item classification-fact 

Passage-science 

Item classification-fact 

Passage-science 

Item classification-fact 

Passage-instructional 

Item classification-main idea 

Passage-instructional 

Item classification-sequence of events 

Passage-social studies 
Item classification-fact 

Passage-social studies 

Item classification-inference 



B-6 
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•^1. Passage-social studies 

Item classification-inference 

42. Passage-social studies 

Item classification-main idea 

43. Passage-science 

Item classification-inference 

44 . Passage-science 

Item classification-fact 

45. Passage-science 

Item classification-main idea 

46. Passage-narrative 

Item classification-fact 

47 . Passage-narrative 

Item classification-inference 

48. Passage-narrative 

Item classification-inference 

49 . Passage-nar rat ive 

Item classification-sequence of events 

50 . Passage-science 

Item classification- fact 

51 . Passage-science 

Item classification-inference 

52 . Passage-science 

Item classification-inference 

53 . Passage-science 

Item classification-inference 

54. Passage-social studies 

Item classification-inference 

55. Passage-social studies 
Item classification-fare 

56. Passage-social studies 
Item classification-fact 

5 7 . Pas sage-s c ien ce 

Item classification-fact 

58 . Passage-science 

Item classification-fact 
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59 . Passage-science 

Item classification-main idea 

60 • Passage-science 

Item classification-inference 



ERLC 



B-8 
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Reading Test Specifications 
Form VMT 



Grade 4 Grade 7 

!• Words 15 items 15 items 

A. Synonymous (BEGIN: start) 9 15 

B. Illustrative (RELUCTANT: "IM 

really rather not.") 4 , 0 . 

C. Analytic (IMPRACTICAL: not practical) 2 0 



II. Sentences 

A. Inference-test word not in sentence 
but inferred from sentence 

B. Straightforward comprehension- 
tests word in sentence, underlined 

C. Words in Context 



15 items 



7 
0 



10 items 



0 
10 



III. Reading Comprehension 

A. Items 20 items 35 items 

1. Fact 4 12 

2. Inference 10 12 

3. Main idea 4 4 

4. Application of ideas 2 0 

5. Sequence of events 0 4 

6. Fact/Opinion 0 3 

B. Passage Content 6 passages 8 passages 

1. Narrative 4 1 

2. Social Studies 1 2 

3. Science 1 4 

4. Instructional 0 1 



ERIC 
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Mechanics of Written English - Form VMT 
Spelling - Grade 4 



1. Spelling by sound alone 

2. Misunderstanding of rules for word formation 

3. No error 

4. Spelling by sound alone 

5. Misunderstanding 'of" rules for word xransf ormaxion 

6. No error 

7. Reversing of letters 

8. Spelling by sound alone 

9. Misunderstanding of rules for word formation 

10. No error 

11. Spelling by sound alone 

12. No error 

13. Misunderstanding of rules for word transformation 

14. No error 

15. Misunderstanding of rules for word formation 



Effectiveness of Expression - Grade 4 

16.-43. Questions cesting effectiveness of expression ask 
the student to demonstrate his sensitivity to 
language by selecting the wording which, in addi- 
tion to being grammatically correct, is best in 
sentence structure and word order and is most 
precise and appropriate in idiom and diction. 



B-10 
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Punctuation and Capitalization - Grade 4 



44. Capital letter - first word of sentence, proper noun; 
period at end of sentence 

45. Apostrophe - possessive, contraction 

46. Capital letter - first word of sentence, first person 
"I"; comma in date 

47. Capital letter - first word of ^sentence; question-mark 

48. Comjaa - direct address; capital letter - proper noun 

49. Capital letter - proper noun 

50. Apostrophe - contraction 

51. Period - abbreviation; comma - address 

52. Capital letter - proper noun 

53. Capital letter - first word of sentence, proper noun 

54. Comma - direct address (letter greeting) 

55. Comma - in quotation; quotation marks - direct quote 



i ER^ 
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Mechanics of Written English - Forrn VMT 

Spelling - Grade 7 

1. Common mispronunciation 

2. Spelling by sound alone 

3. No error 

4. Misunderstanding of rules for word formation 

5. Misunderstanding of rules for word formation 

6. No error 

7. Misunderstanding of rules for word transformation 

8. No error 

9. Misunderstanding of rules for word formation 

10. Misunderstanding of rules for word formation 

11. No error 

12. Misunderstanding of rules for word formation 

13. No error 

14. Misunderstanding of rules for word transformation 

15. Spelling by sound alone 

16. No error 

17. .Common mispronunciation 

18. Misunderstanding of rules for word transformation 

19. No error 

20. Misunderstanding of rules for word formation 

Effectiveness of Expression - Grade 7 

21. -50. Questions testing effectiveness of expression ask 

the student to demonstrate his or her sensitivity 
to language by selecting the wording which, in 
addition to being grammatically cbrrect, is best 
in sentence structure and word order and is most 
precise and appropriate in idiom and diction. 



B-12 

53 



Punctuation and Capitalization - Grade 7 



51, Capital letter - personal title, common/proper noun 

52'# Capital letter - common/proper noun; unnecessary 
comma 

53 • Comma - in series; capital letter - proper name 

54 • Comma - appositively; unnecessary comma 

^ 55.- Quatafrion marks - title; comma appositivel}^; _ ^ 
unnecessary comma; capital letter - common/proper 
name 

56 • Hyphen - compound adjective; quotation marks - 
direct quote; capital letter - direct quote; 
end punctuation 

57. Apostrophe - in plural form; capital letter - 
proper name; comma - with conjunction; period - 
end of sentence 

58. Apostrophe - in possessive; capital letter - in 
personal title; period - in abbreviation 

59. Capital letter - common/proper noun; comma - 
after introductory phrase; apostrophe - in 
contraction 

60. Apostrophe - in possessive; question mark 

61. Capital letter - common/proper noun; unnecessary 
semicolon; capital letter - proper name 

62. Comma - in date; capital letter - common/proper 
noun 

63. Comma - after introductory clause; capital letter - 
proper noun; colon/comma confusion 

64. Capital letter - proper name; comma - apposition; 
period - end of sentence 



ERLC 
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Mechanics of Written English Test Content Specifications 

Form VMT 



Spelling 

A, Misunderstanding of rules for word 



formation 

B • Misunder s tand"" 
transformation 

Reversing of letters 

D. Common mispronunciation 

E. Spelling by soun*^ ^lior:* 

F. No error 



f rules for word 



Grade 4 



15 items 



2 
1 
0 
4 
5 



Grade 7 



20 items 



3 
0 
2 
2 
7 



II. Effectiveness of Expression 28 items 30 items 

Questions testing effectiveness of expression ask the student 
to demonstrate his sensitivity to language by selecting the 
wording which, in addition to being grammatically correct, is 
best in sentence structure and word order, and is most precise 
and appropriate in idiom and diction. 



III. Punctuation and Capitalization 

A. Capital letters 

1. First word of sentence 
2e Proper names 

3. First person "I" 

4. In personal titles 

5. In quotations 

B. Period 

1. End of sentence 

2. Abbreviation 

C. Question mark 

D. Other end punctuation 



12 sentences 

4 
5 
1 
0 
0 

1 
1 
1 
0 



14 sentences 

0 
11 
0 
2 
1 

2 
1 
1 
1 



ERLC 
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Ill* Punctuation and Capitalization (Cont'd.) 



E* Comina 

!♦ Address, date 
2* Direct address 
3» Series 
4» With quotations 
5. Apposition 
6» Unnecessary 
Quotation marks 

1. Title of short publication 

2. Direct address, direct quote 

G. Apostrophe 

1. Possessive 

2. Contraction 

H. Colon 

I. Semicolon 
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Grade 



1. Number and Operations - operations with integers 

2. Number and Operations - operations with integers 

3. Number and Operations - place value 

4. Applications - word problems 

5. Geometry and Measurement - properties of polygons and the circle 

6. Mathematical Sentences - equations 

7. Number and Operations - place value 

8. Applications - word problems 

9. Number and Operations - operations wi integers 

10. Geometry and Measurement - units of u. .asure 

11. Geometry and Measurement - perimeters and areas of simple polygons 

12. Number and Operations - operations with integers 

13. Number and Operations - operations with integers 

14. Number and Operations - estimation 

15* Relations, Functions, Graphs - reading and interpreting graphs 

16. Applications - word problems 

17. Applications - word problems 

18. Mar-heinatical Sentences - inequalities 

19. Relation's, Functions, Graphs - use of mathematical formula 

20. Number and Operations - place value 

21. Geometry and Measurement - scale drawings and maps 

22. Number and Operations - properties of opera ions 

23. Number and Operations - operations with integers 

24. Nximber and Operations - special properties of zero and one 

25. Logical Thinking - intuitive ideas 

26. Geometry and Measurement - angles and intuitive ideas of geometry 

27. Number and Operations - properties of operations 

28. Applications - woru problems 

29. Number and Operations - operations and integers 

30. Number and Operations - place value 

31. Number and Operations - special properties of zero and one 

32. Number and Operations - proper fractions 

33. Mathematical Sentences - evaluations 

34. Number and Operations - proper fractions 

35. Number and Operations - proper fractions 

36. Number and Operations - properties of integers 

37. Geometry and Measurement - units of measure 

38. Applications - word problems 
39 • Applications - word problems 
40. Applications - word problems 
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Mathematics - Form VMT 
Grade 7 

!• Number and Operations - operations with intergers 

2. Number and Operations - special properties of zero and one 

3. Mathematical Sentences -inequalities 

4. Number and Operations - special properties of zero and one 

5. Number and Operations - properties of operations 

6. Number and Operations - operations with integers 

7. Number and Operations - proper fractions 

8. Number and Operations - properties of integers, divisibility 

9. Applications - word problems 

10. Geometry and Measurement - perimeters and areas of simple polygons 

11. Relations, Functions, Graphs - use of mathematical formula 

12. Number and Operations - place value 

13. Geometry and Measurement - units of measure 

14. Number and Operations - properties of operations 

15. Mathematical Sentences - inequalities 

16. Geometry and Measurement - non-metric geometry 

17. Number and Operations - operations with integers 
18.. Application - translation of phrases 

19. Number and Operations - decimals and per cents 

20. Geometry and Measurement - perimeters and areas of simple polygons 

21. Geometry and Measurement - scale drawings and maps 

22. Logical Thinking - intuitive ideas 

23. Geometry and Measurement - non-metric geometry 

24. Applications - word problems 

25. Relations, Functions, Graphs - reading and interpreting graphs 

26. Mathematical Sentences - equations 

27. Relations, Functions, Graphs - reading and interpreting graphs 

28. Geometry and Measurements - perimeters and areas of simple polygons 

29. Geometry and Measurement - units of measure 

30. Number and Operations - average 

31. Relations, Functions, Graphs - reading and interpreting graphs 

32. Applications - word problems 

33. Applications - word problems 

34. Geometry and Measurement - units of measure 

35. Applications - word problems 

36. Number and Operations - proper fractions 

37. Geometry and Measurement - units of measure 

38. Number and Operations - estimation 

39. Number and Operations - properties of integers, divisibility 

40. Number and Operations - proper fractions 
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Mathemafics Test Content Specifications 



FORM VMT 

Grade 4 Grade 7 

I. NUMBER AND OPERATIONS 20 Items 16 Items 

A. Operations with integers 7 3 

B. Place value 4 1 

C. Properties of integers, divisibility 1 2 

D. Proper fractions 3 3 

E. Decimals and percents 0 1 

F. Properties of operations (coinmutative , 2 2 

associative, distributive, closure) 

G. Estimation 1 1 

H. Special properties of zero and one 2 2 

I. Average 0 1 

II. GEOMETRY AND MEASUREMENT 6 Items 10 Items 

A. Units of measure: length, weight, time 2 4 

temperature, money 

B. Perimeters and areas of simple polygons 1 3 

C. Scale drawings and maps 1 1 

D. Properties of polygons and the circle 1 0 

E. Angles and intuitive ideas of geometry 1 0 

F. Non-metric geometry 0 2 

III. RELATIONS, FUNCTIONS, GRAPHS 2 Items 4 Items 

A. Use of mathematical formula 1 1 

• B. Reading and interpreting graphs 1 3 

IV, LOGICAL THINKING 1 Item 1 Item 

A. Intuitive ideas: Counterexample 1 1 
reasoning 

V. MATHEMATICAL SENTENCES 3 Items 3 Items 

A. Equations 2 1 

B. Inequalities 1 2 

VI. APPLICATIONS 8 Items 6 Items 

A. Translation of phrases 0 1 

B. Word problems (other than those 8 5 
already listed in one of the 

categories above) 

Note: At least one- third of the problems 
could be classified as applications. 
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APPENDIX C 



Participants on the Icem Development Committees 



ERIC ^ 



Fourth Grade 



Seventh Grade 



READING 



Dr. Doris Kilanski 

Department of Educational Leadership 
Eastern Michigan University 
Ypsilanti, Michigan 

Mr. Robert Rodgers 
Consultant 
Oakland Schools 
Pontiac, Michi'^an 



Mr. John K. Arbour 
Principal 

VJyli3 Middle School 
De%ter, Michigan 

Mr. Walter Scbczak 
Reading Consultant 
Southfield Public Schools 
Southfield, Michigan 



Mrs. Beverly Chamberlain 
President 

Michigan Reading Association 
Ann Arbor, Michigan 



Dr. Sylvia Kinnunen 
Professor of Education 
^^orthern Michigan University 
Marquette, Michigan 



Mr. Kenneth Cogswell 

Regional Coordinator, Language 

Arts and Social Studies 
Livonia, Michigan 

Mr. Victor K. Peterson 
Superintendent 

Shiawassee Intermediate School District 
Corruna, Michigan 



ENGLISH 



Mrs. Bcstte Powers 
Teacher 

Dearborn City Schools 
Dearborn, Michigan 

Mr. William W. Powell 
Principal 

Fowlerville Community 
Fowlerville, Michigan 

Mrs. Dorothy Yancey 
Special Teacher 
Pontiac City Schools 
Pontiac, Michigan 

Mrs. Alma Petrini 
Specialist 

Detroit Publis Schools 
Detroit, Michigan 

Mr. Ronald Cruickshank 
Teacher 

Switzer Elementary School 
Utica, Michigan - 

ERJC 



Mrs. Maxine Brule 
Principal 

Washington Elementary School 
Watervliet, Michigan 

Mrs. Delores Minor 
Supervisor, Senior High English 
Detroit Public Schools 
Detroit, Michigan 

Mr. George Weber 
Department Chairman 
Bamum Junior High School 
Birmingham, Michigan 

Mrs. Pauline Sampson 
Department Chairman 
Anderson Junior High School 
Berkley, Michigan 

Mrs. Joanne Gilbert 
Teacher 

Henry Ford Middle School 
Highland Park, Michigan 
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Fourth Grade 



Seventh Grade 



MATHEMATICS 

Mr. Russel J. Ruber 
Principal 

Avalon Elementary School 
St. Clair Shores, Michigan 

Mr. Arthur Behrmann 
Principal 

Hartland Consolidated Schools 
Hartland, Michigan 

Mrs. Annette Vogelsang 

5th Grade Teacher 

Forest Hills Board of Education 

Grand Rapids, Michigan 

Mr. Thomas McMillan 
Research Center Teacher 
George Roberts Elementary School 
Sterling Heights, Michigan 

Mrs. Mary Jane Franklin 
Elementary Teacher (all subjects) 
Wyoming Board of Education 
Wyoming, Michigan 



Mr. Terrence Coburn 
Math Consultant 
Oakland Schools K-12 
Pontiac, Michigan 

Miss Dorothy McAnulty 
Teacher 

Mary Lyon Junior High 
Beulah, Michigan 

Mr. Richard Knob loch 
Teacher 

Eisenhower High School 
Romeo, Michigan 

Mr. Dave Thomas 

Mathematics Department Chairman 
Brownell Middle School 
Grosse Points Woods, Michigan 

Mr. William Schewe 
Department Chairman 
MacDonald Middle School 
Lansing, Michigan 
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MICHIGAN EDUCATIONAL ASSESSMENT PROGRAM 
1972-73 CORRELATION TABLES* 



DISTRICT MEAN CORRELATIONS 

Unweighted, Grades 4 and 7 
Weighted, Grades 4 and 7 

SCHOOL MEAN CORRELATIONS 

Unweighted, Grade 4 
Unweighted, Grade 7 
Weighted, Grade 4 
Weighted, Grade 7 



*See Local District and School Report: Explanatory 



Materials for definition of variables • 



CORRELATIONS AMONG DISTRICT MEANS BASED UPON DATA FROM THE 1972-73 
MICHIGAN EDUCATIONAL ASSESSMENT PROGRAM, UNWEIGHTED 



INTERPRETATION OF SYMBOLS USED IN CORRELATION TABLES 

SYMBOL INTERPRETATION 

PIS/K Professional instruction staff per 1,000 pupils 

T/K Teachers per 1,000 pupils 

AVG EXP Average years teaching experience 

% MAST Percent of teachers with master's degree 

AVG SAL Average contracted salary of teachers 

SEV/P State equalized valuation per resident member (1971-72) 

LR/P Local revenue per pupil (1971-72) 

SSA/P State school aid per pupil (1971-72) 

lE/P K-12 instructional expense per pupil (1971-72) 

EIE/P Elementary instructional expense per pupil (1971-72) 

TCOE/P Total current operating expense per pupil (1971-72) 

% MNRTY Percent of racial-ethnic minority students 

MIL Total operating millage (1971-72) 

D 0 RAT School dropout rate (1971-72) 

4 WRD R Word relationships. Grade 4 

4 READ Reading, Grade 4 

4 ENG Mechanics of Written English, Grade 4 

4 MATH Mathematics, Grade 4 

4 COMP Basic skills composite achievement. Grade 4 

7 WRD R Word relationships. Grade 7 

7 READ Reading, Grade 7 

7 ENG Mechanics of Written English, Grade 7 

7 MATH Mathematics, Grade 7 

7 COMP Basic skills composite achievement. Grade 7 

4 MEM Grade 4 membership 

7 MEM Grade 7 membership 

TOT MEM Total membership 
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D-6 



CORRELATIONS AMONG DISTRICT MEANS BASED UPON DATA FROM THE 1972-73 MICHIGAN 
EDUCATIONAL ASSESSMENT PROGRAM, WEIGHTED ACCORDING TO TOTAL DISTRICT MEMBERSHIP 



INTERPRETATION OF SYMBOLS USED IN CORRELATION TABLES 



SYMBO L INTERPRETATION 

PIS/K Professional instructional staff per 1,000 pupils 

T/K Teachers per 1,000 pupils 

AVG EXP Average years teaching experience 

% MAST Percent of teacbo*:s with master's degree 

kVG SAL Average contracted salary of teachers in thousands 

SEV/P State equalized valuation per resident member (1971-72) 

LR/P Local revenue per pupil (1971-72) 

Sb'A/P State school aid per pupil (1971-72) 

lE/P K-12 instructional expense per pupil (1971-72) 

EIE/P Elementary instructional expense per pupil (1971-72) 

TCOE/P Total current operating expense per pupil (1971-72) 

% MNRTY Percent of racial-ethnic minority students 

MIL Total operating millage 

D 0 RAT School dropout rate (1971-72) 

4 WRD R Word relationships, Grade 4 

4 READ Reading, Grade 4 

4 ENG Mechanics of Written English, Grade 4 

4 MATH Mathematics, Grade 4 

4 COMP Basic skills composite achievement, Grade 4 

7 WRD R Word relatl /nships. Grade 7 

7 READ Reading, Grade 7 

7 ENG Mechanics of Written English, Grade 7 

7 MATH Mathematics, Grade 7 

7 COMP Basic skills composite achievement. Grade 7 



D-7 

70 



I 

< 

s 



• •••••••••••• 



• •••••••••• 



(/> ^ P^ 



a; 




o 



•4 

O 

Ui 

UJ QC 

9> «/» 

lU Q 

U> >• 
^ CO 

X 



o 

UI 



«->»• 

a 



IM 
»/> 

o 

u, 
o 

ic 

UI 

00 

UJ 
X 



Ui 

UL 
O 

(A 

s 



s: 



1A« 

ii 

> 



p^p^Op^Op^*^-4p^p^p^p^^C>p^p^«^p^-<p^^.-#p^^ 



O Q cr^ 9 p4 p^ 

^ <n 09 o 
i# o ^ 

O 9» p^ op (O 

r» ^ «o ^ 9 « 
^ Ki p^ M en <30 

9 o o o o o 



$3 

CD 

IT 
^ CM 
• • 

o o 



o o 

m en 
• • 



O 3 

o« in 

p^ p^ 
• « 

o o 



« GO 

m « 
o o 



u> in 
o o 



a o o 
<^ o 0% 

0 « m 

01 MO 

o o m 
N «n CO 
in u% in 
• • • 
o o o 



3 a a 

ca ^ <^ 

oj nir; 
<r Q 

O p4 P^ 

lA tn m 
• • • 

o o o 



3:? 

-4 (A 

in c4 
ir <M 
<n ni 
m «n 
• • 
o o 



oocoa>flOaO'^0<^VJOOCpaoaot/*0*ir<7^V»<^<^<7»^ 



OOOOOOOOQOQOO 




CO 9 ^ ^ o in 

^ . _ . gj^ ^ 

^ CO 
O CO 



cr«iu*u**nu^o4>fn«Moofnt>#^oooooooooo 



OOOOOOOOOOQQOaOOOOQOOOOO 



a. ^ >• 

>UJ0Ct0iU*-«O •-^ 



< a X a u X CL 
a;uj2<oof:iJZ<<0 

OJIflCMJSrullQCUiXO 



ERIC 



71 



D"8 



Ul 



• •••••••••••••••••••••0* 

i ) t f I t t « I I t I 



Ul 



1 I I I I t I I I 1 I 



OOOOOOO^OOOOQOOOOOOOOOOO 

I I I t 1 t I III I I I I I t I t I i I 



a. 




OOOOOO^^POOOOOOOOQQOOOOOO 



> 



raM^U>^Oa09^ lO^^^OOOOOOOOOOOO 
• ••••••••••••••••••••• 

00000«40p0000000000000000 



ERIC 



UJ 

O 
o 



3 

! 

IS 

(/I 
ft 

X 



a 



:5 ^ 



> 

ro 
O 

Jii 

X 
aj 



X 



Ui 



^QO0«-«0O^00O000<j><j>0C>^OO^^(j» 



OOO^OOOOOOQOOOOOOOOOOQOO 

i t t 











O -4 




fn 












in ^ 


CM 


(A 








>o 


p4 


r- 


O 




a 


N 




o 


t 


o 












r- 














M 


oo 






p4 


X 






o 




o 










>o 






u^ 


.n 








N 




o 




p4 


Ui 


O 




o 


























-4 










o 






• 

o 


• 


• 




• 

o 


• 


6 


n 


• 

o 


• 

o 


• 


• • 


• 

o 


r 


• 


• 

O 


• 

O 


d 


• 


o 


• 

o 


• 


< 




• 










1 












1 


1 


1 


1 


I 


1 


i 


• 


1 


1 




o 


o 






a* 












tO 


m N 




p4 










o 


o 




f- 






o 














i 














m 








^1 










o 




MM 








o 








M QD 


O 






Ol 






CO 


«o 


OO 


'JO 






o 








m 






o 


















cn 




m 




en 




• 


• 


• 


• • 


• 


• 


• 


• 


• 


i 


• 


• t 


• 


• 


• 


• 


• 


• 


• 


• 


• 


0 








Q 


o o 


O 




o 


o 




O 


a 














o 


o 


o 


o 


(J 


> 
>• 






1 


1 1 






1 




1 




1 


1 
























Q 


o 


r» 


«r o 






u> 


o 




rg 


fn 












in 




o 


CM 


<n 


r- 




O 








« 




Ol 






v» 














<r 




fn 




<n 


r- 




o 


o 








CO 








a 


o 


^ in 


rry 


o 






•"^ 




o 






0^ 


:^ 


o 














<n 










rn 






en 


fo 




fn 


M 


fn 




>i 

</) 




Id 








1 






1 










1 























X ^ a. 

UJ4/)i/)0L 0» Ql*SOC 



< Q 3^xa 



^. ^• h« 



D-9 



>0 JO ^ 'JO ^ 

3 JoQOOOOOOOO 
II I I I f 



O ^ >0 >0 O C O S\ ^f\ J" >0 
I I 



o 



I I I I I I I I 



OQQQOOOOQOOQOOOOO 
I I I t I t » I 



O O O Q O O 



S OOOOPOOOOQOOOOOQ'^OOOOOOO 

T I T t I I t I I 



I I I I T T I I 



09 
Z 
Q 

< 

UJ 

o 



CM 



2 



a 
oc 
2: 



o 

•-4 



o 

LU 
X 



4t: 




C9000000000000»^0000000000 

II I I I I I I I t I I I I 



UOOOUQOOOOOOp^OOOOOOOOOOO 

I t i 




•••••• •••••••0«***** 

OOOOOOOOQOV^f^QOOOOOOOOOOO 

II I » I I i t I I I I I 



■!3 



iU 



X 

< 

z 
a 



o 
o 



oooaooooc;>o«*^^^poooooQ0090Ci 
f I I I I I I I I I I 



X 

u 




UJ 

oc 

o 
u 



a u > H* ic 

xi» < a. < o X a o x et 

f/>i^oxo>x<N»*^QX-J3»Qt:uJXO'«at:aixu 



73 



D-3.0 















a: 














h» M 










h» M p4 






•J 


a 


(7» OO p4 






Q 










a: 




• • • 


• • 






u 


O o o 


o o 




Ui 




1 


1 












O 












u 


















< 






f*> (7^ f«> 






Hi 




O v« C7« 




Ui 






m fo « 




c& 
oc 


DI 


MA 




• • 


o 






• 


t 


u 


>• 










<A 


















u 


O 




N o 


o ^ 


Ui 




O N p4 










r» 4> o 






X 




M n 


o ^ 




o 












UJ 




o o 


O 


lU 




1 


1 






1^ 




M 










-4 










• 






o o 










rrv ^ CO 


GO 






O 


O 00 ^ 




H» 




< 


fo en ^ 




Z 


X 




• • • 


• • 


Ui 


»^ 


QC 








cjC 




• 


1 




H 








< 








Ui 










sA 




















< 


o 












































X 






Ui 




^ UJ 




X 


QC 








u 


« 










o 








X 






a ^ 





ERIC 



N O 


>o 


o 








or* 


u> oo o 




0* 






o 


O 


o 












hi O O 




o 


OO 




o 


^ o tn 


(M 






fn p<v 




o 


p4 *^ ^4 






CO 


oo 


o 


o ^ ^ 








oo ^ 


00 




n% Ok 

^ V 












• • # 


• 


• 


• 


• • 


• 




• • • 


• • 


• 


• 


• 


• 


ooo 


O 


o 


O 


OO 


O 


O 


OOO 


O O 


O 


O 


O 


p4 


1 


1 


1 


1 


1 


1 
















(^ ^ in 










CO 


^ 


(^ ^ oo 






o 


o 


M 


fn «o 


r» 








N 


00 


^ 00 u% 






o 


o 




N p4 U% 


O 


in 








0* 


O o 








o 


00 


O 


N 






00 N 


CO 


00 


40 0« 


^ Ql 




<^ 


o 










• 

o 




• 

o 


• 

o 


do* (J 


dd 


• 

o 


t 

o 


« 


» 

o 


• 


1 


1 


• 


1 


1 
















m h» 


«0 




o 


(^ oj 








<^ in 


m 


o 


o 






<^ 


m 


cn 


oo N 


m 




p^OO 


in csi 


tn 


o 


o 


00 


m CO (n 




m 


o 


O 






o o<^ 


o « 




o 




00 


o OJ 


(M 


<n 




00 o( 




no 


OK 00 






o 




a* 




O 


o 


O 


oo 




O 


ooo 


o o 


o 






o 


1 


1 


1 


1 


1 


1 
















m oi 


ca 


<n 


00 








<M «>| fO 




o 


vn 






p» a» a* 






1^ 






a> 


f 


tn 


o 


tn 


Hi 


o 


^ <p fn 






M 






O 


o o 




o 




41 




O 






Oi 


oo M 


00 




0^ a* (T 




o 








• • • 


• 


• 


• 


• • 


• 


• 


e • • 


• • 


• 


• 


• 


• 


ooo 


o 


o 


O 


o o 


o 


o 


ooo 


o o 




o 


o 


o 


• 


1 


1 


1 


1 


1 
























>• 








QC 
















0. 




< 




Q X 








X 


& 






a 






QC 


O 


< OH 


X u 


< 


o 


H 


X 




a 




Ui 






OC 


UI Z < 


ooc 


Ui 




< 


o 


> V ^ 




Ui 


o 




a 








QC 


Ui 






Ui oc (y> 


























«/i «j (/> 




UJ 




^x 


o 


















o 



CO 
M 

H 
O 



O 

a 



CO 
S3 



CO 
O 



CO 
O 

o 

cxi 



o 

M 



a 

o 
o 
o 



a* 



CO 

c 
o 

•H 

O 

u 

CO 

c 



03 
C 

o 

CO 
CO 
(U 

o 

M 
P4 











CO 














4J 














c 










0) 




QJ 










M 














60 


CO 












Q) 


U 


4J 












lit: 


CO 








(U 


CO 


O 


>v 








O 




CO 


4J 








c 




CJ 


•H 








Q) 


QJ 


4J 


M 








•H 


4J 




O 








M 


CO 




C 








(U 


CO 


o 


•H 










B 










CO 


X 












iH 


(U 




u 


O 






•H 




4J 


CO 










60 




i-C 


c 








c 


> 


CO 










hi 


CO 


CO 








o 


O 


M 




1 


CO 




o 


CO 




QJ 


I-C 


CI4 




o 


QJ 




4J 


CO 


•H 






4J 


O 


O 


•H 


J3 




r-l 




CO 


CO 


O 


CO 






CO 


0) 


u 


CO 


c 




u 


u 


4J 


u 


u 


0 






CO 




c 




•H 




(X 


QJ 




o 




4J 






>v 


o 


o 


o 


CO 




CO 










iH 


60 


u 


Q) 


4J 


QJ 


4J 


QJ 




to 


a 


60 


a 


M 


a 




CO 


QJ 


CO 


QJ 






O 


M 


O 


M 


O 




•u 


CO 




M 


QJ 


M 


U 


CO 


0) 




QJ 




QJ 




QJ 


H 




(l4 






1 


0^ 



CO 



00 

c 
c 



u 
o 

CO 

o 

c 
2 

QJ 



4J 

s 



a 

CO 



CO 

o 

i- 

o 
a 

CO 
iH 
iH 

CO 



CO 
CO 











M 




0 




<f 




















CO 


CO 


u 


M 


QJ 


QJ 






•i 


•i 


QJ 


QJ 


6 


6 


QJ 


»-c 




CO 


CO 


u 


M 


0 


a 


H 



CO 
M 

(1^ H 



H 
CO 



5^ 



5 



CO 

w 



I 



D-12 



ERIC 



75 



I 



• •••••••••••• 



00 

o 

u 

X 

u 



UJ 
Q 



Ui 

O 



2 
X 

Ui 

< 

X 

o 



f>i 



O 



Ui 
9 



Ui 

f 

Ui 
X 



4n 
UI 

OC 

u. 

Q 



UI 



0» CO 

in 

cyo 
• • 

mo* 
o ^ 

mm 



r4 00 

t • 

N Ol 

^ o 



04 <no 

CM 9^ 
lA • • 

(^ ;o 09 

«A nO M 
^ O ^ 

«n or* 



0^ •»< p4 
«# ^ 
^ 

• « • 

m »n 
00 >9 o 

N r« ct> 

(A <0 
Q ^ rn 

^ ^ 



wo 00 
w v9 

«o 

O Q 
lA M f*» 

ra f-0 «o 
r» Q a> 

•i^ <^ 
-I ^ »n 

<n 
• • 



tow 

lA ^ 
«0 CO 

9^ «0 
OO 0^ 

m o* 
a» ^ 
o 



fa fO 
CO *«l 

»AO 
• • 



CO 

-O • 
O 



>!• O f* C4 O Q 

CO ro rri Q o 

^ <n «n CI <r o o 

(A CO in 4* lA o o 

• •••••• 

Ol O <e en ^ 
O N f» oo <0 fO ^ 
#^4 <0 0» "I* 41 (A 

o» a» 01 o N ^ 
M ^ 01 <N >o Ol 

#4 



i/) j< o 
04 X > 



a ^> «i o X 

Ui «0 OC QC *4 

flcuiasHoSo 



ERLC 



76 



I>-13 



< 

X 



• •ft 

ooooooo*-«ooo 



o o 



X 
iA 



-J" 

UJ 



#••••••••••••* 

OOOOOOOO^OOQO 



or 



oo•-•oo^oc^oc^(^<^•^^M 
• •^••t««««««« 

OoOOOOOp^OOOoO 

t I t 



0^ 



• •••••••••••• 

I It 



> • tf\ in vO ^ 1^ o 

4- .-M O <A O 

o o o ^ o 
X ••>••• 

X O O O O O *H 

I 



in ^ o CO o *A <o 

C>i ^ ff| ^ ^ ® 

c^ M fvj ^ 

in nO vn ^ >o oj ^ 

• • • • • t • 

o o o o o o o 

t I I I t 



o 
< 

O 



(J 



UJ 



> 
< 



X 



^o*o* %^ON» r> o <o \g\ <^ ^ ^ 
<^4.(i'^Oin>0in4'tnm(M«>i 

• •••••••••••• 

f 



• •••••••••••• 

OOOi^OOOQQOOOQ 



•^'^oo<ntn^•^•»o^■^oc^ 
• •••••••••*•• 

00-4*^000000000 



cooo*^^*n<^0'***^ rn^N*^ 
(f>Qf^m>t<\i^tnu>h.^^>4» 
r^o^o^oooooorgoi 
• •••••••••••• 

O-^'JO^^OOOOOOO 

lilt t I 



X 
X 



h»^9«cv<»oor»^<n(^0('*o 

;>iniO<Hni<nfMniMnic>|t0O 
• •••••••••••• 

OOOOOOOOOOOO'*^ 

Iff I t t u t 



0l«MOO-4O<#««»^'^N»-tOa0 
00000000000*^0 

III I I I I t 



X 

'JJ 
-o 
l/> 

o 



ERJC 



'X 

o 

3 

5: 
3 



3^ 



oco u^'^^o^•u^•^c^o^A^• 

O'n^OOt^'^JO^OI-^*^' 
Or-Or-IOOOOOOON'V 
• #••••*••••** 

•*4000000000000 



a, ^>-JOZ XX 

«C oj i/) (/) 0^ ac M XX 
X < z Q «i J& a 
t/>^ v;;xoxa<o»-»xo>-» 



a 

X 

a 



77 



O^^t^^^O^NinOt^OCMO 

co(^<n^<**'04h*<i'o«oms 

00«>400^0*trChO^O'^M 
• •^•••••••••« 

OOOOOOOOOOf^OO 

I ^11 



X X 



a ^ > ^ c9 X 

K H Oi X ^ 

< X Q ^ Z 0» 

> ^ «XMiX^uaO 

^«f4K«fJlQ(iAIXUOM 



D-14 



I 

X 



#^ ^ N <n«<i 



I— ^ ^ CM f^llO 



Ul 



s 

X 



CO 



UJ 

or 
o 

X 



f* CO 

t t 



^ N 
u» ^ 
C^fM 

t ten 

•4 m M 

flO f*l 



^ in 
cv cr 
in CO 

ii 

^1 a» 



^ >o >e 
^ M 

• ft 

CO ^ ^ 

^ mm 



« O0» 
« OO 

(M ^O 

m 

^ <^ 

m cfk ^ 

w ♦ 

«M t t 

OO 



Ul 

o 



HI 

)3 

Ul 
< 



(3 
S 



X 



> 

Mi 



li. 

a 



X 



X 



X 



OS 

> 



ERIC 



om 

oio 
• t • 

lAO 

o m<o 



M O 
^O 
9^0 

«»<o 

t • 

m ^ 

C4f4 



0nl^•>^•^<^00 
(7* c» ^ 4>oo 

Qi <9»<4^<fl9iOO 

Xi^'Oo^i^oo 

o^o<9m*r9^^4' 
o^ooO'>4or^«^ 
^ ♦ ^ ^ ^ *A 
fi4m 



a ^> ^ox XX 

XH<H»UIX</) UJUl 
LU(/>^XO^^M XX 
< X O «J X tt> 
XC>XO<3>»X OH 

^ > qcvwac^uoco 



</) :iC ^ 



78 



D-15 



X 



o ^ ^ n fO • 4 >0 ^ O ;0 ;0 
rr\ ^ ^ \f\ ^ ^ Q ^ 

ooooooooa-<ooo 



X 



oooooooo ^oooo 
It I • 



a 

a: 



UJ 

Q 

a: 



• •••••••••••1 



X 



• ••••••••• • • • 

ooooo ^ooooooo 
II I I I I I 



o 

Q 
X 

u 



(/I 
> 



oooo^oooooooo 
7 , I I I I 



"it ••••••••••• 

ooomooooooooo 



UJ 

a 
< 



ac 
o 



42 

UJ 



Z 

o 



a. 
> 



/> 

ou 



• •••••••••••• 

00»H000O0000O0 

I I < 



0*^00000000000 

III It 



ot>nn^o^Ofloro*n^inc4 

OlA^f*»C*^>4 0»'^tAO^^<ft 
OO'OOOOOOOiHOrilN 
• •••••••#•••• 

HOOOOOOOOOOOO 

III I « 



r»o«Mo<Ni*ft0^nfla:?5<50 
»ncnoo4*^«'i*^^'"*'^*'^2 

rg<^Of^**1»^Or4^^Hf*»0 
OoOOOOOOOOOOi^ 

11 I f • I I 



ui oo fi «>i m;^ ^ ^ 9 

5 ^•^r-ioj<X"<o»^<-i«-*»^o»*» 
• •••••••••••• 

a 00000000000*^0 

Sill t I I I I 



rI.in«>#o»i^*ntf\toi**f;P^«A 
oI-l•^-<o^•<l»<^«^<^o•^»^ 

OOOOOOOOOOi^OO 



z 



ERIC 



u 



a: c 

•^1 



CL «J > ^ O X 

X M ^ W> iil Z gO 
\jj iA X CC ^ 
^ < Z O ^ X «L 



79 



a •j>^tdx ^z 

*^'N> > flC»A*Z<lJQCO TW16 





(0 
































•H 
















CU 








s 
























P. 








hn 








o 








4J 


CO 






o 










4J 






o 






U 


c 


c 












VJ 


•H 














V.' 

6U 


CO 


ud 






M 








M 


4J 














(U 


CO 






Pi 






CO 




>v 






MH 




O 




to 


4J 










c 


M 




•H 




o 


to 






Q) 


4J 


M 






4J 




•H 


4J 




O 






0) 




M 


CO 




C 










(U 




o 


•H 










D< 


§ 










to 


03 






>v 






C 


iH 


Q) 




M 


o 






o 


•H 




4J 


to 








•rl 


a 


60 




I-C 


c 






4J 




C 


> 


to 








a 




•H 




CO 


4J 












CO 




QJ 




M 


M 


o 


o 


M 




■ 1 


CO 




4J 


o 


to 




0) 


iH 


D* 




03 


o 


(U 




4J 


to 






a 




4J 


o 


o 










I-C 




to 


to 


O 


0} 








03 


(U 


M 


to 


c 




i-C 


u 


U 


4J 


4J 


M 


o 




to 




to 




c 








c 


Cu 


(U 




o 




4J 




o 




>v 


o 


o 


c 


to 




•H 


03 










I-C 




03 


M 


(U 


4J 


0) 


4J 


QJ 




03 


Q) 


60 


c 


60 


c 


M 






Xi 


to 


0) 


to 


QJ 








O 


u 


o 


u 


O 






O 


to 






0) 


M 


M 










0) 




0) 






P4 


H 




PL4 






1 



60 

a 
to 

0) 



J3 
CO 



C 



O 
CO 

o 

a 
to 

o 

0) 



c 



> 

a 
to 



03 
O 

B 
o 
a 



0) 

<o 



CO 



H 
CO 



CO 
O 



M 



M 



O 




D-.17 



80 



z 



• •••••••••• 

OOOOOOOOOfMO 

t 



I 

o 
I/) 



^ CD fO 



i: 



^ €0 m 



M O O p-4 O O « 0> 9^ O ^ 0" 



Ul 



• •••••••••• 

oooooooo^oo 



o 
o 



ONOO^•o^•Q^*^l^ 
o^ooo^»c^O(^90^ 

OOOOQOO^OOO 

I 



o 



• •••••••••• 

oooooo^oooo 
t 











o 




o 




X 




u 












Ui 




O 




< 












» 












o 










z 


< 


Ui 




z 


LU 




'X 




cL 


o 


O 




o 


z 










; 




Ui 




X 


i 


u> 




wO 


u 


Ui 




(/) 






> 








o 






o 








X 





2: 



• 



CO 
Ui 

o 



ERJC 







o 


u. 




o 




CO 




X 














a: 




a 












< 




> 


I/) 




T. 






I/) 

S 


(/) 


u. 




o 




u: 




UJ 




CD 


UJ 


X. 


«i 


z> 


CO 


z 








oJ 




X 




H- 





• •••••••••• 

^ fO eg o ^ ^ ^ < U^ 



oo(rcrtf>oooooo 



o o 

O (9 

o o 



o o 

^ CM 

o m 

• • 



o o o 

^ 0> h- 

o oo m 
<r ^ 

^ OJ (T 

CO r4 <^ 

^ fO 4" 
p4 M N 
• • • 

o o o 



CO 0^ 
00 (M 

in 
in in 
nj ^J 
• • 



o 
o 

o 

xO CO 

^ in 
N fvi 
t • 

o o 



rr\ CO 
CO O 
CO 

O O 
• C 

^ O 00 

^ ^ <r m 

o o o 



10 CO 

o o 

o o < 



««4 CO CO 00 CO CO CO 
M O O O O O O 

O O O O O O Q 
CM ^ t\S 00 

to O ^ ^ ^ <f' ^ 
h- fNi *^ h- ^ 

rg >r ^ m cr m ^ 

N CO «0 Q «C ^ 
(M 9% ^ O M ^ 

p4 ^ 4* m in in in 
• •••••• 

o o o o o o o 



a j> X 

X K ^ a* Z i/> 

UJ u* t/) /tr or: >^ 
>^ <f Z ^ 3C « 



Z 
Ui 
X 



o 

OC 

z 

Ui 



o 
x 

> 

CO 

3 
UI 

X 

o 



z 



< 



CL 
UJ 

o 
> 



CO 



K 

cc 

< 
X 



Ui 

oc 



in^Nh-'i'O^ochO*^ 
inoc>O'0Of»ofl0*-<^ 

• •••••••••• 

ooooo^ooooo 

11 i i I t I 



^OO^OO-^h-f^^COK 
fM^C^^O^mmOQOOO 

o^tn^oo^ooooo 

• •••••••••• 

0000*^000000 

I I 



C^OJO^h^ChOfVif^m 
<Oh>CMO-4tn^h>QO^O 
^h>'0O<#O^njMf^<^ 

oomo'O^ooooo 

• •••••••••• 

ooo^ooooooo 

I 



a^^>onlO^»'0Of^'0tn 

tA^0(M9^M^in0^b» 

oo<ro^^o*p»^^o 
ooominooo^^^ 
• •••••••••• 

oo-^oooooooo 



-40h>^0<»0nj^N0 
aoo*irfr^^^K>otno^c«( 

inoo»f»coc>f>ioo*n«^ 

h-OOO^^^^Ori4^ 

i •••••••••• 

Of^OOOOOOOOO 

till 



o•^c^(^(^lnlnoc^o^ 
ocoin^f^i^^mf^Nin 
Otnco^omoco^oco 

0h-0000f««00^0 
• ••••«##••• 

^oooooooooo 
I I I 

a .J > -I O X 
X < H Ui Z 

^ ui(/)(/)ccac*^*^ 

««t Z O ^ X A. 

•.•^> > o^uJz<tfe> 



D-18 



o 
o 



^oininN«#9^^h>MO 
in^h>ooo^(^m^h>o 
co^omni^(neo«r*o 

Op4^OOr«»0^9'9'O'O 

• «§•••••••• 

OOOOOOOOOOM 

I 





o 


X 


X 4 H Ui 


z 


(/) 


X Ui i/» a: QC 




M 




D 


«J X (1 


3^ O X O X o 




O X 


•M V > > W 


Ui 


IP «E O 


a H « ^ < »^ 


ec 


Ui r o 



CI 

u 

X 

o 



• 



4: «J 

Ml VI 

< CO 



f 



1: 



rM 



• •••••••••• 

CM . 



• •••••••••• 

<n m ^ >r ^ *n ^ 





VI 






Ui 




• 








< 




m 








a 






to 


CI* «-l 


in 




Q 


<n 


a. 






0 


<n 0 


















CP 0 









0 




00 




V9 










0 






00 






xa 


0 


4» 






(M 


0 








0 
















a* 
















a 












J) 




:3 


a 




> 




«n 




• 






• 


CD 




r- 


CO 








-4 






m 


CI 


CO 


04 


m 


r» 


u 








cr 








m 




m 




m 


tn 


«^ 




/I 


m 


a* 






nt 








0 


o 


ir 


CO 






f*> 




p4 


vn 












4i 


a 










00 




wo 


























0» 


CM 














• 


• 




• 


• 




• 


• 


• 


• 


• 


0 




0 


0 






0 




0 


Q 


0 


0 


0 , 



2 



u 
o 

X 

> 





m 


00 




^ u> ^ 




0 


r*o 






m 




^• 








*MO 






m 




0 


^ - 






«no 


r» 










-4 0 










X 


• 


• 


• 


• • • 


• 


• 


• • 


• 




0 






0 Q 0 


0 


0 




0 










1 1 










X 
































Of* 




X 




m 


d 








o«M 












^ 0 


















-4 0 










•J 


• 


t 


t 


t t t 


t 




t t 


• 




CI 






poo 


0 


0 


«^o 


0 


X 








1 1 










UI 
























CM 


en 


m 


0 


«o 




UI 


a» 


a 






to 


0 






X 




CM 


0* 






0 










fM 








0 






Q 


• 


t 


t 


• t t 


t 


• 


• • 


t 








C3 


000 


0 




00 


0 


X 








1 1 












«c 




0 




0 




01 91 


IM 




JO 




00 


«i <M(n 


0 


00 


mm 


0 












0 








X 




^M 




p4 Of* 


0 










• 


• 


• 


• • • 


• 


• 


• • 


• 


u 








0 00 




0 


SIO 


0 


X 








1 










a 


















CM 






0 mo 


to 




IMC^ 












^ «»o 










>• 






0 




« 




<n « 


X 


X 








0 










X 


• 


• 


n 


• • • 


• 


9 


• • 


• 


X 








0 o«^ 


0 


0 


00 


0 




f 


f 


1 




1 


1 


t 1 


9 


M 


























^ om 


CO 




9 «n 


^ 








fM 


9> 09» 


<M 




«^ 


CO 


< 


^• 




(A 


«n OP- 


«4 




CI »n 


tM 


4/1 


0 








0 


0 


00 


0 




• 


• 


« 


• * • • 


• 


• 


• • 


• 




0 






0 ^0 


0 


0 


uo 


0 


> 


1 


1 








1 


t f 


9 
























>0 




0^0 














J* 


<M 


0 a» 






^ m 


o» 






r- 












<n 


V> 


#^ 


0 


>r 


0^0 


«4 






*^ 



ooooooooouo ^ 

X 

o 



ERIC 5 



«9 


Ui 












X 


«l 




a 








3 








•» 






X 




X 


UI 






X 






> 








X 


Ji 




lA 




X 


0 


X 


X 




m 


X> 




> 








a 


H < 


ft 


< 


¥^ 



a 

> 



X 
>- 

>c 

X 

X 
X 

o 



X 

to 



X Ui X 



X 

s 



D-19 



ooo-^ooooooo 



tn«^Of^^^ocMm^o 
>r^orM(M^9oor*^ 
0't)0-'ntnooG^mo«-4 

^QO^tnO*^0«4«4»4 

oo«-4aoac3oooo 
t I I 



0 


•-4 






CM 






CO 




^ 0 


ao 








0 


(n 


c^ 




rr> Q 


QO 


r* 


CM ty* 




CM 


Oh 




CM 


0 


0 


0 




<M 






CM 


M 


• • 


• 


• 


• • 


• 


• 


• 


• 


• 




0 


Vii 


00 




0 


0 


0 


0 




f 




1 t 












0 


m 




0 M 




Ml 


Oh 


fO 




0 












0* 


1*1 




0 'n 




en 


f « 






CO 


JTk 


CM 


0 v» 






00 




*^ 


CI 






^0000000^0 






1 




• f 













X 



^<jo»»<coM'^«r'no 
a'jv:>ooouooo^ 



a «j o X 

X H <H* Ui /) 
lit ajy)>iXXi^»<4 
X < X Q ^ X a 
(/9xOxoxa4«OH>x 



X «J >* <U O X 

H <V UJ 2 «i1 

X *4 X ◦ ^ X CL 

wr> X o X X ^ at 



